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HIGH DENSITY INTEGRATED CIRCUIT PACKAGE ARCHITECTURE 

CROSS-REFERENCE TO RELATED APPLICATION 
[0001 ] This application claims the benefit of U. S. provisional application number 
5 60/474,005, filed May 29, 2003 . 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] This invention relates to integrated circuitry and, in particular, to the architecture of 

1 0 a high density integrated circuit package. 

[0003] Modern computers and other electronic devices make use of integrated circuitry, 
which is favored for its efficiency of manufacture, speed of operation and low power consump- 
tion. As is known in the art, these advantages increase as the density of circuit elements in the 
integrated circuitry grows. Conversely, these advantages can be diminished by the inadequate 

1 5 removal of heat produced by the operation of the integrated circuit, by the introduction of 

lengthy connectors between integrated circuit chips and other such factors. In designing pack- 
aging for integrated circuits, it is generally desired to pursue an architecture that enhances the 
advantages of the integrated circuitry. 

20 Related Art 

[0004] Published United States patent application number US 2002/0053726 Al of Mikubo 
et al, entitled "Semiconductor Device Attaining Both High Speed Processing And Sufficient 
Cooling Capacity", filed November 8, 2001, discloses a semiconductor device in which a plu- 
rality of wiring boards carry semiconductor modules (e.g., memory chips) and an integrated cir- 

25 cuit chip (IC chip) that is connected to the wiring board. The IC chip carries a microminiature 
heat sink secured to it. A plurality of the wiring boards are stacked one above the other and the 
circuits thereon are interconnected via socket connectors. A coolant is flowed through the heat 
sinks on each of the IC chips in the stack of wiring boards (see paragraph 0055 and Figures 5 
and 6). A heat sink may be formed from two metal blocks, one of which has a series of fins 

30 that define grooves on one surface and the other of which has a mating surface for the fins. The 
blocks are secured together with the fins of the first block pressing against the receiving surface 
of the second block to form a plurality of channels between the two blocks. See paragraphs 
0079 through 0086. 
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SUMMARY OF THE INVENTION 
[0005] This invention relates to an integrated circuit package comprising a plurality of cir- 
cuit wafers each comprising a non-electrically conductive substrate on which is carried one or 
more integrated circuits with at least one wafer configured for signal communication outside 

5 the package, and a plurality of non-electrically conductive cooling plates alternately layered 
with the circuitry wafers, wherein the circuitry wafers and cooling plates are layered in a first 
direction that defines a first axis of the package, and wherein signal communication between 
circuitry wafers within the package occurs in a direction along the first axis, wherein the cool- 
ing plates are configured to direct heat flow in a path that is transverse to the first axis, and 

10 wherein at least one of power, data signal and control signal communication is supplied to the 
package from a direction that is transverse to both the first axis and the direction of heat flow. 
[0006] According to one aspect of the invention, the cooling plates may define flow con- 
duits therethrough for coolant fluid, wherein each flow conduit has two conduit ends and 
wherein the conduit ends are aligned at two different positions on the side of the package, and 

1 5 wherein the package further comprises manifolds that provide a port through which to provide 
coolant fluid to a plurality of flow conduits and a port to collect cooling fluid from a plurality of 
flow conduits, and wherein the manifolds are configured to permit access to the side of the 
package for providing at least one of power, data signal and control signal communication to 
circuitry wafers in the package. 

20 [0007] The invention also provides an integrated circuit package comprising a plurality of 
circuitry wafers each comprising a non-electrically conductive substrate on which is carried one 
or more integrated circuits with at least one circuitry wafer configured for signal communica- 
tion outside the package, and a plurality of non-electrically conductive cooling plates alter- 
nately layered with the circuitry wafers, and comprising circuitry wafers and cooling plates con- 

25 figured so that integrated circuits on at least two circuitry wafers in the package communicate 
with each other through an intervening cooling plate. 

[0008] According to one aspect of the invention, the package may comprise cooling plates 
that define flow conduits therethrough for coolant fluid. Each flow conduit may have two con- 
duit ends and the conduit ends may be aligned at two different sides of the package. The pack- 
30 age may further comprise manifolds that each provide a port through which to provide coolant 
fluid to a plurality of flow conduits and a port to collect cooling fluid from a plurality of flow 
conduits. Optionally, the manifolds may be configured to permit access to the side of the pack- 
age for providing power and/or control signals to circuitry wafers in the package. 
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[0009] According to another aspect of the invention, at least one cooling plate may com- 
prise a plate signal path therethrough and a first IC on a circuitry wafer on one side of the cool- 
ing plate may be positioned for signal communication through the plate signal path. Optionally, 
there may be a second IC on a circuitry wafer on the other side of the cooling plate, positioned 
5 for communication with the first IC through the plate signal path. Optionally, the first IC may 
comprise an optical IC and the plate signal path may comprise a plate optical signal path, and 
the second IC may be a second optical IC. 

[0010] According to another aspect of the invention, at least one circuitry wafer may com- 
prise a substrate having a signal path therethrough and a first IC may be positioned on the sub- 
1 0 strate for signal communication therethrough. Optionally, the first IC may comprise an optical 
IC and the substrate signal path may be an optical signal path. Optionally, there may be a sec- 
ond IC on a substrate, optionally a second optical IC, positioned for signal communication with 
the first IC via the substrate signal path. 

[0011] According to still another aspect of the invention, the circuitry wafers and cooling 
1 5 plates may be layered in a first direction along a first axis, and the circuitry wafers and cooling 
plates may be configured to permit signal communication between circuitry wafers in the first 
direction, the cooling plates may be configured to direct heat flow along a path that is trans- 
verse to the first axis and at least one of power, data signal and control signal communication 
may be supplied to the package from a direction that is transverse to both the first axis and the 
20 direction of heat flow. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] Figure 1 A is a schematic perspective view of an integrated circuit package according 
to one particular embodiment of the present invention; 
25 [0013] Figure IB is an exploded view of the integrated circuit package of Figure 1 A; 

[0014] Figure 2 is a schematic perspective view of a circuit substrate in the integrated cir- 
cuit package of Figure 1A, showing communication/power bus wiring and apertures on the sub- 
strate; 

[0015] Figure 3 is a schematic perspective view of an array of integrated circuit chips 
30 mounted on the communication/power bus wiring of the substrate of Figure 2; 

[0016] Figure 4 is a schematic exploded perspective view of a cooling plate in the inte- 
grated circuit package of Figure 1 A; 

[0017] Figure 5 is a schematic cross-sectional view of the integrated circuit package of Fig- 
ure 1A; 
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[0018] Figure 6 is a schematic representation of an integrated circuit package according to 
this invention, showing orthogonal directions of cooling, data and power through the package; 
[0019] Figure 6A is a schematic perspective view of an integrated circuit package with two 
cooling manifolds according to this invention; 
5 [0020] Figure 6B is a schematic perspective view of an IC package according to another 
embodiment of this invention; 

[0021J Figure 6C is a schematic perspective view of a modular connector configured to 
electrically engage the circuitry wafers of the package of Figure 6B; 
[00221 Figure 6D is a schematic, exploded, perspective view of a cooling manifold for a 
1 0 rectangular IC package according to this invention; 

[0023] Figure 7 is a plot of surface area density for an integrated circuit package according 
to this invention; 

[0024] Figure 8 is a plot showing the relationship between bus capacity and surface area in 
an integrated circuit package according to this invention; and 
1 5 [0025] Figure 9 is a plot showing the relationship between power dissipation and surface 
area in an integrated circuit package according to this invention. 

DETAILED DESCRIPTION OF THE 
INVENTION AND PREFERRED EMBODIMENTS THEREOF 

20 [0026] This invention relates to a high density architecture for an integrated circuit package 
in which a plurality of circuitry wafers are disposed in a stack and are alternately layered with a 
plurality of cooling plates, and wherein signal communication to and from at least one circuitry 
wafer is provided through at least one cooling plate. Each circuitry wafer comprises a substrate 
with one or more integrated circuit chips thereon. There may be integrated circuit (IC) chips 

25 deposited on both sides of a substrate, and chip-to-chip signal communication may be provided 
through a substrate from a chip on one surface of the substrate to a chip on the other. The cool- 
ing plates may comprise solid, heat-sink structures or may define conduits therethrough for the 
flow of a heat exchange fluid. An integrated circuit package according to this invention may 
have any desired geometrical shape and will permit heat exchange for cooling the package and 

30 one or more of electronic power and data signal and control signal communication, to occur in 
three generally mutually transverse, e.g., preferably orthogonal, directions through the package. 
Thus, the arrangement of manifolds, modular connectors and other coupling devices that facili- 
tate these functions from outside the package can be simpler and/or more easily designed than 
for prior art IC packages. 
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[0027] An integrated circuit (IC) package in accordance with one embodiment of this in- 
vention is shown in Figures 1 A and IB. IC package 10 has an optional cylindrical configura- 
tion and it comprises a plurality of circular circuitry wafers 12 arranged in substantially parallel 
relation to each other with a plurality of circular cooling plates 14 disposed between them to 
5 form a stack and, preferably, with cooling plates for the top and/or the bottom strata of the 

stack. As explained more fully below, each cooling plate comprises a generally planar structure 
having a pair of planar surfaces and a plurality of channels 14a through which a cooling fluid 
may flow. In addition, each cooling plate 14 has one or more communication apertures 14b 
formed therein to allow electrical communication from one side of the cooling plate to the 
1 0 other, e.g., from a circuitry wafer immediately below the cooling plate in the stack to the cir- 
cuitry layer immediately above. 

[0028] The circuitry wafers and cooling plates 14 are stacked in a first direction that defines 
a first axis of the package. Communication apertures 14b thus allow electrical signal commu- 
nication, e.g., data exchange or transfer and/or the transfer of control signals, with and/or within 

1 5 the package in a direction generally parallel with the first axis. 

[0029] Each circuitry wafer 12 comprises a substrate 12a as shown in Figure 2. The sub- 
strate 12a preferably comprises a layer of silicon. On the substrate 12a there is formed a bus 
channel 16, which comprises lines of electrical conductors that provide power to, and/or control 
and/or data signal communication with, integrated circuit chips that can be mounted on the sub- 

20 strate (in communication with a bus) using any suitable technology, e.g., flip chip bonding (in 
which an IC chip is equipped with an array of contact pads configured to coincide with matched 
junction points for the bus). The bus could also include control circuitry for both signal and 
power conditioning. Typical signal control functions provide bus contention, crossbar switches, 
and error correction; whereas power conditioning control functions include voltage regulation, 

25 over current protection, and error correction. By providing such circuitry in the bus channels, 
there will be more room for memory and processor chips to be mounted on either side of this 
wafer. Thus, as shown in Figure 3, a plurality of IC chips 18, which may comprise processor 
chips, memory chips, or the like, can be deposited on the bus channel 16 so that the chips prop- 
erly communicate with one another and can be accessed externally via outgoing and incoming 

30 bus lines on the periphery of the chip array. Optionally, a communication/power bus and array 
of IC chips thereon may be deposited on both sides of the substrate. 
[0030] Referring again to Figure 2, substrate 12a comprises one or more communication 
apertures 12b, which permit signal communication through the substrate 12a. Optionally, the 
communication aperture 12b may accommodate a metallic signal carrier joined to a chip or 
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communication/power bus on opposite sides of the substrate, but preferably, aperture 12b is op- 
tically transparent (e.g., hollow or filled with a light-transmissive material such as a short length 
of optical fiber) so that optical signal communication can be achieved therethrough using any 
desired optical integrated circuit (optical IC) signaling technology, e.g., light-emitting chips 
5 such as laser chips, light-emitting diodes (LEDs), etc., and light-receiving and signaling devices 
such as photodiodes, phototransistors, etc. 

[0031J In an optional but preferred construction of the cooling plates 14 (Figures 1A, IB), 
each cooling plate is formed from a pair of mated, plate-like cooling elements. The cooling 
elements are configured to have mating surfaces which, when joined together, form coolant 

10 flow channels extending through the resulting cooling plate. For example, as seen in Figure 4, 
the mating surfaces of the two cooling elements 14c and 14d may have grooves 14e formed 
therein. The grooves are separated by ridges 14f that can be mutually aligned, so that when 
cooling elements 14c and 14d are secured together, they form a cooling plate 14 (Figure IB) 
having channels 14a extending therethrough. (Alternatively, the mating surface of one of the 

1 5 cooling elements may be flat, and the channels may be defined by ridges in the mating surface 
of the other cooling element.) Each channel has at least two ends so that there can be at least 
one inflow end through which coolant fluid can enter the cooling plate and at least one outflow 
end from which coolant fluid can exit the cooling plate. In the illustrated embodiment, the 
channels run straight through the cooling plate with their ends at opposite sides of the plate. 

20 When the cooling plates are layered in the IC package, the ends of the channels are preferably 
vertically aligned with each other to permit the use of inflow and outflow manifolds through 
which coolant fluid is easily flowed into and withdrawn from the IC package. In alternative 
embodiments, the channels may define serpentine or other non-linear paths through the cooling 
plates. 

25 [0032] In addition to the grooves and ridges, each cooling element has communication ap- 
ertures 14b formed therein and, when the cooling elements are secured face to face to form a 
cooling plate (14 Figure IB), the communication apertures 14b are aligned so that they can be 
used for signal communication from a circuitry wafer on one side of the cooling plate through 
to the other side of the cooling plate, e.g., to another circuitry wafer, to a communication/power 

30 bus, etc. As with the communication apertures in the circuitry wafers, the cooling element 

communication apertures may accommodate electric communication via a conductor or may be 
optically open (i.e., either hollow or transmissive of a light signal), for optical signal transfer 
therethrough. 



. P- 1728-1 



-7- 

[0033] A high density IC package is assembled in accordance with this invention by alter- 
nately stacking circuitry wafers and cooling plates, as indicated in the schematic representation 
of Figure 5. In the embodiment of Figure 5, circuitry wafers 12 comprise substrates 12a that 
have IC chips 18 mounted on both sides of the substrates 12a. IC chips 18 include laser chips 

5 1 8a- 1 8i with associated controllers to enable laser signal communication in the circuitry within 
IC package 10. For example, laser chips 18a and 18b are mutually aligned with a communica- 
tion aperture in substrate 12a so that the circuitry on one side of substrate 12a can communicate 
optically with circuitry on the other side of substrate 12a (i.e., the two laser chips are optically 
coupled with each other). Similarly, laser chips 18c and 18d are mutually aligned with a com- 

10 munication aperture in a cooling plate so that chips 1 8c and 18d can communicate with each 
other optically, thus enabling the circuitry on a circuitry wafer on one side of a cooling plate to 
communicate through the cooling plate with circuitry on another circuitry wafer on the other 
side of the cooling plate. Laser chips 18e and 18f can communicate optically because commu- 
nication apertures on their respective substrates 12a are both aligned with a communication ap- 

15 erture in the intervening cooling plate 14. Thus, it is possible to align communication apertures 
in both circuitry wafer substrates and cooling plates to permit optical communication through 
both a substrate 12 and a cooling plate 14. 

[0034] Laser chips 1 8g, 1 8h and 1 8i are aligned with optical communication channels in the 
outer (i.e., top and bottom) cooling plates so that they can send and receive optical signals with 

20 devices that are external to, and vertically aligned with, the IC package. (As used in this de- 
scription and in the claims, the vertical direction relative to an IC package is the direction that is 
orthogonal to the planes in which layered circuitry wafers and cooling plates are disposed, i.e., 
the vertical direction is the direction in which the circuitry wafers and cooling plates are lay- 
ered.) Optionally, vertical communication may be used primarily or exclusively for data flow. 

25 The external device may comprise a modular optical connector, e.g., an array of optical fiber 
ends or of solid state optical logic devices, configured to exchange optical signals with optical 
ICs in the package. Accordingly, the positioning of optical ICs 18g, 18h, etc., for vertical ex- 
ternal communication and the pattern of corresponding communication channels in the outer 
cooling plates are matched to the external device. 

30 [0035] The channels flowing through the cooling plates of Figure 5 may extend from left to 
right as sensed in the Figure, a direction that runs parallel to the substrates 12a. The cooling 
fluid may be supplied to, and collected from, the channels by manifolds which will typically be 
situated at opposing sides of the package to accommodate a straight fluid flow path through the 
package. It will therefore be appreciated that the various communication apertures in the sub- 
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strates 12a and cooling plates 14 permit signal communication between circuitry wafers in a 
vertical direction that is orthogonal to the planes in which coolant flows through the cooling 
plates in the package. Optionally, data input and output can be directed vertically through the 
package 10 (as sensed in Figure 5), whereas electrical power and (optionally) control functions 

5 can be provided in a horizontal direction (as sensed in Figure 5) that is orthogonal to both the 
direction of coolant flow and the vertical flow of data signal communication, i.e., in a direction 
perpendicular to the plane of the paper in which Figure 5 is depicted. Representing the IC 
package 10 schematically as a rectangular solid in Figure 6, the architecture of an IC package in 
accordance with this invention permits coolant to flow through the package 10 in a direction 

10 along a "Z" axis; power, data and/or control signals communication can be accommodated ver- 
tically through the top and/or bottom surfaces and/or vertically within the package, along a ver- 
tical or otherwise upward-directed "Y" axis, and/or horizontally along an "X" axis perpendicu- 
lar or otherwise transverse to both the Y and Z axes. Power, data and control signals can be al- 
located to the X and/or Y axes in any desired manner and combination. 

1 5 [0036] It will be understood that IC packages in accordance with this invention need not be 
limited to rectangular configurations, although a rectangular configuration may allow for con- 
venient connection of the package with other components in the cooling system, power supplies 
an other electronic components. For a cylindrical package as shown in Figure 1 A, inflow and 
outflow manifolds (such as manifolds 20a, 20b, Figure 6A) can be configured to occupy only a 

20 portion of the periphery of the package, leaving the remainder of the periphery accessible for 
the lateral connection of a lateral bus that may optionally primarily provide power and control 
signals to one or more circuitry wafers. 

[0037] Such inflow and outflow manifolds facilitate the flow of coolant through the pack- 
age in a plurality of parallel planes that are disposed in perpendicular relation to the direction in 

25 which circuitry wafers and cooling plates are layered in the package. Thus, thermal flow 

through the package is achieved in a horizontal direction orthogonal to the vertical direction in 
which circuitry wafers and cooling plates are layered. Power and signal communication with 
the package may be provided in the vertical direction and/or in a direction orthogonal to the 
vertical direction. By positioning an electrical connector between two coolant manifolds, signal 

30 communication may also be orthogonal to the vertical direction and to the direction of heat flow 
through the package. As shown, inflow coolant manifold 20a occupies only a 90-degree sector 
of the periphery of the IC package indicated by its circular footprint at 10, and outflow coolant 
manifold 20b occupies a diametrically opposite 90-degree sector leaving two lateral 90-degree 
sectors available for lateral connection to a bus for electrical signaling (e.g., for control and/or 
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power and/or data transfer) in a direction orthogonal to the direction of flow of coolant from 
one manifold to the other, at the regions indicated by arrows 22. Each of manifolds 20a and 
20b has a concave face for mating with the stack. Each manifold face carries a deformable gas- 
ket material for contact with the stack. The gasket material is perforated in a manner calculated 

5 to allow coolant to flow therethrough into or out from the cooling plates and to establish a seal 
around each of the flow channels. As shown, the gasket material on manifolds 20a and 20b 
have perforations to match the openings of each flow channel in the cooling layers in package 
10, but, in alternative embodiments, the gasket may be configured to form a seal around a plu- 
rality of such openings in a cooling layer. Accordingly, the circuitry wafers may be configured 

1 0 to include edges with I/O contact pads that protrude from opposite sides of the stack, to facili- 
tate the use of a suitably configured modular electrical connector to that package. Likewise, in 
an alternative to what is shown in Figure 6A, the cooling plates may optionally be configured to 
protrude from the stack, to facilitate the connection of manifolds thereto. Such a connector and 
manifold are shown in Figures 6C and 6D, respectively. 

1 5 [0038] In a generally rectangular embodiment, a package 1 1 0 (Figure 6B) comprises a plu- 
rality of circuitry wafers 112 arranged in substantially parallel relation to each other with a plu- 
rality of rectangular cooling plates 114 disposed between them to form a stack. The circuitry 
wafers 112 and cooling plates 1 14 are rectangular in configuration and are disposed crosswise 
so that their ends protrude from the stack in mutually orthogonal (i.e., transverse) directions. 

20 The protruding ends of circuitry wafers 1 12 will facilitate the use of a modular electrical bus 
connector such as connector 102 (Figure 6C) to facilitate the connection of package 1 10 to a 
source of power and, optionally, control signals and/or data signals for circuitry wafers 1 12. 
Connector 102 comprises a series of slots 115 that are configured to receive the ends of cir- 
cuitry wafers 1 12 and to establish electrical connections between access pins 1 17 and corre- 

25 sponding contacts on the respective circuitry wafers 112. Connector 102 and circuitry wafers 
1 12 can be configured in a generally conventional manner, e.g., to provide for a zero insertion 
force connection. 

[0039] The protrusion of the ends of the cooling plates 1 1 4 in package 1 1 0 permits the use 
of cooling fluid manifolds that are slotted to receive the ends of the cooling plates in a manner 
30 similar to the way connector 102 receives the ends of the circuitry wafers. A suitable manifold 
120, as represented schematically in Figure 6D (in which the package 10 is shown without cir- 
cuitry wafers, to simplify the drawing), may comprise a manifold frame 120a and a gasket 
120b. Gasket 120b has slots 120c configured to receive the edges of the cooling plates that pro- 
trude from the stack, thus forming a seal around the plurality of flow channels in each cooling 
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plate. The gasket 120b is disposed between the manifold frame 120a and the cooling plates, 
and provides a seal around the cooling plates and between the plates and the frame. Frame 
120a includes wedges 120d which are configured to bear against gasket 120b between slots 
120c to facilitate the formation of the seal. 

5 [0040] One measure of expected performance for an IC package is the amount of surface 
area that can be dedicated to circuitry within a given volume. The relationship of substrate sur- 
face area to volume for an IC package according to this invention is illustrated in Figure 7. An 
integrated circuit package having the architecture described herein can provide thirty-two 
square inches of surface area for interconnected IC chips per cubic inch of volume, i.e., a sur- 

1 0 face area density D of 32 square inches per cubic inch. In a representative embodiment, D = 
0.8/w and w = 0.025 inch, where w is the thickness of a circuitry wafer substrate and of the IC 
chips mounted on both sides of the substrate in the IC package, and where the thickness of the 
cooling plates is 2w. The formula includes the surface areas of both sides of the surfaces of the 
IC chips on the substrate and both surfaces of the substrate, so that the total thickness of a cir- 

15 cuitry layer (a substrate with chips on both sides) and an associated cooling plate is 5w. 

[0041] Another measure of performance is the bus capacity exhibited by the IC package. 
As illustrated in Figure 8, the capacity, in gigabits per second, increases as the surface area over 
which a circuit is deposited decreases, because with decreased surface area there are shorter 
communication leads, so signals take less time to travel from one transistor (or other circuit 

20 element) to the next, making the communication line available more quickly for other signals. 
An integrated circuit package providing thirty-two square inches of surface area for intercon- 
nected IC chips per cubic inch of volume in accordance with this invention will accommodate 
data transfer at about one gigabit per second per channel. With increased bus capacity, how- 
ever, there is increased generation of heat. The chart of Figure 9 illustrates that in an IC pack- 

25 age according to this invention, the amount of power consumed by the package increases as the 
surface area increases, but that power dissipation diminishes with increasing surface area. The 
power dissipation in an integrated circuit package according to this invention varies according 
to the type and velocity of coolant flowing through the cooling plates. The expected power dis- 
sipation (PD) at a maximum junction temperature Tj of 70°C, using water cooling at a velocity 

30 of 8.8 feet per second is PD = 339/(L + 0.3) watts per square inch of silicon area, and where L 
is the card length in inches and, using air cooling at a velocity of 88 feet per second, the power 
dissipation is expected to be PD = 0.0975/(L + 8.65 x 10" 5 ) watts per square inch. 
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[0042] While the invention has been described in connection with particular embodiments 
thereof, it will be understood by one of ordinary skill in the art, upon a reading and understand- 
ing of the foregoing description, that numerous alterations and variations may be made within 
the scope of the invention described herein. 



